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Abstract 

In this paper, we introduce a framework of new mathematical representation of 
Game Theory, including static classical game and static quantum game. The idea 
is to find a set of base vectors in every single-player strategy space and to define 
their inner product so as to form them as a Hilbert space, and then form a Hilbert 
space of system state. Basic ideas, concepts and formulas in Game Theory have 
been reexpressed in such a space of system state. This space provides more possible 
strategies than traditional classical game and traditional quantum game. So be- 
sides those two games, more games have been defined in different strategy spaces. 
All the games have been unified in the new representation and their relation has 
been discussed. General Nash Equilibrium for all the games has been proposed 
but without a general proof of the existence. Besides the theoretical description, 
ideas and technics from Statistical Physics, such as Kinetics Equation and Ther- 
mal Equilibrium can be easily incorporated into Game Theory through such a 
representation. This incorporation gives an endogenous method for refinement of 
Equilibrium State and some hits to simplify the calculation of Equilibrium State. 
The more privileges of this new representation depends on further application on 
more theoretical and real games. Here, almost all ideas and conclusions are shown 
by examples and argument, while, we wish, lately, we can give mathematical proof 
for most results. 

Key Words: Game Tlieory, Quantum Game Theory, Quantum Mechanics, Statisti- 
cal Physics 
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1 Introduction 



Game Theory[Tl^ is a subject used to predict the strategy of all players in a game. The 
simplest game is static and non-cooperative game, which describe by payoff function 
G, a linear mapping from strategy space x S"^ x ■ ■ ■ S'^ to N-dimension real space 
M^. For a game in mixture strategy space, in which every player uses mixture strategy 
P*, a probability distribution on strategy set 5"*, Nash Theorem proves that there is 
always some mixture-strategy equilibrium points, on which no player has the willing 
to make an independent change. Therefor, such equilibrium points can be regarded as 
a converged points (or at least fixed points) of the system, then as the end state of all 
players. 

On the other hand, Quantum Game TheoryjSlI^ has been proposed as a quantum 
version of Game Theory |S1 [3]. A typical two-player quantum game is defined as F = 
(Ti, po, Sa, Sb, Pa, Pb), in which 7i is the Hilbert space of state of one quantum object, 
like a photon or electron. Such a quantum object plays an important role in Quantum 
Game Theory. The quantum strategy set Sa or Sb usually is defined as a set of unitary 
operator on state space TC, or sometimes subspace of H. It's believed that because 
quantum strategy space is usually larger than the corresponding classical strategy space, 
one can make use of such advantage of quantum strategy to make money over classical 
player. Generally speaking, a quantum game is not only a quantum version of a classical 
game. It describes the situation that every player plays game in a strategy space of 
quantum operators, which transform the state of a quantum object. Probably, someday, 
some original quantum games can be found alone this direction. 

However, both of Classical Game Theory and Quantum Game Theory are expressed 
in single player strategy space, so the payoff function is a (0, N) tensor G* (s^, s^, . . . , s^) , 
mapping a combination of single-player strategies onto a real number. On the con- 
trary, in Quantum Statistical Mechanics, a matrix form of Hamiltonian H is used 
in a any-particle case, and the form of density matrix of equilibrium state is always 
p = e~^^ . So a system- level description will unify our formulas for A^-player game, 
and then maybe improve our understanding and calculation. 

Starting from such an idea, in this paper, we construct a systematical way to reex- 
press everything into system-level description, including system state and its space, pay- 
off matrix on system space, and reduced single-player payoff matrix. Then Canonical 
Quantum Ensemble distribution is used to describe system equilibrium state. So ideas 
and technics from Statistical Physics can be easily applied onto Game Theory. Such 
application implies a probability that a Kinetics Equation can be used to describe an 
evolution that a system ends at the equilibrium state starting from an arbitrary distri- 
bution. Because the traditional Game Theory only cares about the macro-equilibrium 
state, the Kinetics Equation approach is just pseudo-dynamical equation leading to the 
equilibrium state. The dynamical process itself might be meaningless. 

Furthermore, besides providing a new pseudo-dynamical approach, the distribution 
function description has its own meaning. In Game Theory, maybe general for all 
economical subjects, usually it's supposed that even the difference between two choices 
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is very small, the high-value one is chosen. This is unnatural when the difference is 
smaller than the resolution of human decision. Therefor, we use a distribution function 
to replace the maximum-point solution. This means player i will choose strategy 

with probability e^^ even there are another strategy can make more money. Here, 
P is the meaning of average resolution level, or in Statistical Physics, the average noise 
level. Unfortunately, although the ensemble description is the second topic of this 
paper, only some special case study has been investigated. A general form for any 
game is still waiting for more exploration. 

Section ^constructs the new representation for classical and quantum game. Sec- 
tion ^use ensemble distribution and pseudo-dynamical approach to study the equi- 
librium state in this new representation. Discussion of relation between our new repre- 
sentation and quantum, and classical game is included in section ^ A lot of questions 
are pointed out in the discussion section (®. Section fj^l is a short summary of the 
conclusions we have reached. 



2 Mathematical Structure: Strategy Space, State Density 
Matrix and Payoff Matrix 

Strategy set can be continuous and discrete, and this will effect the mathematical form 
of all variables, such as the state of player i is or p'^^5{s'^ — s^), and G will be 

integrations or matrixes. In order to compare with the Mathematical form of Quan- 
tum Mechanics and point out the similarity, and to unify Classical Game Theory and 
Quantum Game Theory, here we use the discrete strategy, although the corresponding 
transformation of all ideas and formulas is quite straightforward. Most of our formulas 
and results can be generalized into A^-player and ^Hi^i -^i^ "Strategy game, so for sim- 
plicity of expressions, at most time, a 2-player and (Li x L2)-strategy game is used as 
our object. 



2.1 The new representation of static classical game 

For a A^-player game, we suppose the strategy space of player z is S"* = { , S2 , • • • , } . 

The state of player i is |P*) = {p\,p\, - • • ,PlJ'^ and Yl^'=i = 1- The payoff function 
of player i is a (0, A^)-tensor — a A^-linear operator, 

E\P\P\ . . . , P^) = (|pi> , |p2) , . . . , . (1) 

Specially, for a 2-player game, G* can be written as a matrix ((0, 2)-tensor) so that 

E\P^,P''-) = {P'^\G^\P'^) , (2) 

in which is Li x L2 matrix, not necessary a square one. So a classical game is 

Tc = {{S^],{G^]). (3) 
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A general vector in 5* can be defined as 

\p')=i:pU'].)^ (4) 
11=1 

in which { } is the base vector set of strategy space . Or in traditional language of 
Game Theory, it's a set of all the pure strategies of player i. 

Inspired by the application of Hilbert Space in Quantum Mechanics, now we intro- 
duce two ideas into Game Theory. First, to redefine the strategy space of single player 
as a Hilbert Space. Second, to use a system state to replace the single player state. 
Then, at the same time, a new form of payoff function is required to be equivalently 
defined on the system state. 

A single-player state vector \P^) is written in a new form as 

It's density matrix form of a mixture state, because a classical strategy of player i is 
to use strategy with probability p^. The difference between equlHJ) and equ© can 
be regarded as just to replace with |s^) The reason of such replacement will 
be clear when we do it on quantum game. Actually, using density matrix to describe 
mixture state is a approach in Quantum Mechanics. A system state of all players is 
defined as 

N 
i=l 

A typical form of system state of a 2-player (player 1 and player 2) and 2-strategy 
(strategy (a,/3) and strategy (/u,z/)) classical game looks like 

p' = PaPl \(^P) (a^l +PaPl W^) +pgpl + p}pI {(3v\ . (7) 

In fact, the base vector set of Hilbert space of system state of players can be defined 
as direct product of single player base vector as 

N 

\S^):=\si,sl...,s^) = J{\sl). (8) 

i=l 

Then from equ© and equ®, it can be proved that a system state have the form as 

P' = T.Ps,\S^){SA^ (9) 

in which 

N 

Ps, = Up\^- (10) 

1=1 
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One can compare this general form with the specific one of 2 x 2 game, equQ. Some- 
times, we neglect the subindex and denote jS'^;) as \S). In such situation, we should 
notice that a capital S denote a general system base vector. 

Such replacement provides a probability to use pure strategy other than the tradi- 
tional classical pure and mixture strategy. We will discuss this in section ^2.31 Now we 
try to transform payoff function into system-level form while the invariant condition 
is equ(^. In a density matrix form, the formula used to calculate the payoff is 

E\p') = Tt{p'W) = {S\ p'W \S) , (11) 

s 

The solution of equQ and equ (fTT|l gives the relation between and G*. Since those 
two equations should give the same value for any state, we can choose the system 
state as a pure strategy, or in our language, the base vector of system state. Let's 
denote \Sq) = [sj, Sq, • • • , Sq^), which means every player choose a pure strategy Sq, 
then Pq = Ss^gi^. Then eau (fTT|) give us 



E\\S^) {So\) = {S\So) {So\ W \S) = {So\ W |5o) 
s 



So 



{So\W\S,) = G^{\sl)Asl),...As^)). (12) 



The diagonal elements of W can be calculated explicitly. And for our general system 
density matrix as equQ, only the diagonal terms effect the payoff value i?*, all others 
can defined as zero. For example, of a 2-player game is 

= E V l«' ^1 • (13) 

This means W is diagonal matrix. 



2.2 Prisoner's Dilemma as an example 

Before we continue our further discussion, let's use one example to present our abstract 
Mathematics and to compare the traditional and new from of state vector and payoff 
function. The traditional payoff function of Prisoner's Dilemma is 





Cooperate 


Defect 


Cooperate 


-2,-2 


-5,0 


Defect 


0,-5 


-4,-4 



Then 



G^ 
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The traditional state vectors are 

\p'f' = pl\c)+p\\D), \py'' = pI\C) + pI\D) . 

By substituting the above two equations into equ@, we get 

= -^pIpI - ^pIpI + • pIpI - ^PdPl 

By the new notations, state of player 1 is 

p'=pI\c) {C\+p\\D) {D\. 

and system state is 

= pIpI \CC) {CC\ + pIpI \CD) {CD\ + p\pI \DC) {DC\ + p\pI \DD) {DD\ , 
or in matrix form, 



pIpc 














1 2 
PcPd 














1 2 
PdPc 














Pdpl 



Then from eauH13|). we know the new payoff function, 

-2 " 



0-50 

-4 _ 

We can check it by substituting into eau ((TT|) as, 

= Tr [p'H^) = -2pIpI - bplpj + • p^pl - Ap\pl (15) 

which is the same value with eau ()14() . So the new representation includes all the 
information in the traditional notation, however, more complex it seems. But such 
complexity brings some other benefit including Equilibrium State calculation and gen- 
eralization into Quantum Game Theory. 

2.3 Quantized classical game: expanded strategy space 

Till now, since the classical strategy is a mixture strategy of the base vector (strategy), 
we always use density matrix to represent a single player state or a system state, such 
as in equ© and equ® • Now we ask the question that what's the pure state of strategy 



-2 -5 




Pi 


-4 




Pi. 





-5 



0-4 
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(but other than the classical pure strategy) means in Game Theory? A pure strategy 
vector of player i in our representation is 



(16) 



Therefor, the density matrix of such a pure state is 

impure \pi\P'^'^^ / j:)i\P'^^^ 



p 



(17) 



The density matrix of a pure state has off-diagonal elements while the classical mixture 
density matrix has only the diagonal elements. It seems that pure strategies expand the 
strategy space. Whether it has significant result in Game Theory or not? Comparing 
eau (|T7)) with equ©, if we suppose 



(18) 



that every diagonal element of pure density equals to corresponding one of mixture 
density matrix, then those two states will have similar meaning. Let's use the Prisoner's 
Dilemma as an example again to check if they will give different payoffs. Although we 
still can follow the calculation of mixture state by density matrix method as in equ (|ll|) . 
there is an equivalent but much simpler formula for pure state calculation, 



Where 15") is a pure state vector defined direct product of single player state as 
\S) = |pi> . . . := . . . , pN^ . 

Specially, for Prisoner's Dilemma, the system state vector is 

\S) = xlxl \CC) + xlxl \CD) + x\xl \DC) + x\xji \DD) . 
Combined with new payoff matrix , 



(19) 



(20) 



r -1 -2 



1™2 



1™2 
d-^d 



-2 














-5 





























-4 



5PcPd + • PdPl - ^PdPd 





12" 

X^X^ 




1 2 

/-ft -L /-ft 

■^c-^d 




1 2 
•^d^c 




1 2 
. -^d-^d . 



the same value as eau ((n|) and eau ((T3|) . 

Pure state p^^v^"^^ equals to the diagonal term plus some off-diagonal elements. The 
same payoff value implies that in our situation, only the diagonal term makes sense. In 
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fact, generally, it's because of the diagonal property of 
we know 



s 



{S\pH'\S) 



E 

s 



{S\p\S)Hl 



From eau (|TT|) and eau lfT^ . 

(21) 



s 



PssHl 



It means that even p^^v^"^^ has off-diagonal elements, only the diagonal parts effect 
the payoff. In one word, the mathematical form of vectors in Hilbert space, or the 
equivalent density matrix form, brings nothing new into Game Theory but an equivalent 
mathematical representation. System state can be a pure state or a mixture state, but 
since the payoff matrix is diagonal, they make no difference. The quantization of 
Classical Game is a new game only when both density matrix and payoff matrix have 
off-diagonal elements. Although density matrix can have the off-diagonal terms, the 
relation of equ (|12j) between the new payoff matrix and the traditional one guarantees 
that W can only have the diagonal term. So this quantization condition has no classical 
meaning in Game Theory. 

Now the question is if we quantize it anyway, what's the meaning? Is it possible 
to find any real world objects for such a theory? If we find such an object, does the 
relative phase in state vector play any roles in such situation? And further more, the 
vector space gives us the freedom to choose our base vectors, does such transformation 
play any roles? The expanded strategy space provides another class of possible state. 
In the mixture classical density matrix, a system density matrix ia always has the form 
as equ®, which is a direct product of all single players. If pure state is permitted, 
a general system density matrix may not be a direct product, but an entangled state 
of all single players. Does such an entangled density matrix have significant effect on 
Game Theory? 

At the last of this section, lets come back to question of the meaning of the off- 
diagonal term of payoff matrix by referring to an example. What's the meaning of 
e in the payoff matrix below? 



-2 








ei 





-5 




















€2 








-4 



-2 








£2 




















-5 





ei 








-4 



(22) 



2.4 The new representation of static quantum game, with quantum 
penny flip game as an example 

The representation of classical game above strongly depends on the base vectors of 
strategy set. But in classical game, such base vectors are predetermined and artificial. 
They are just the original discrete basic classical strategies. No inner product has 
been predefined between them before our construction of the new representation. Now 
we turn to Quantum Game Theory, and fortunately it will provide us a very natural 
explanation of our base vectors. 
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The proposed and developing Quantum Game Theory is different with our Quan- 
tized Classical Game Theory. While our approach is a representation, the Quantum 
Game Theory is a quantum version of Game Theory. It use the idea of Game Theory, 
but all operations (strategies) and the object of such operations are from quantum 
world [3]. A typical 2-player quantum game is defined by 



r = pq, Sa-, Sb, Pa, Pb) 



(23) 



in which Ti is the Hilbert space of the state of a quantum object, /?o is the initial state 
of such an object, Sa,Sb is player A or B's set of quantum operators acting on 7i. 
And Pa,Pb are their payoff functions. 

Using well-known Quantum Penny Flip Game[H] as an example, spin of an electron 
is used as penny, so the base vectors of H are \U) ,\D). The initial state is chosen as 
Po = \U) {U\. The classical operators are to flip the penny or not, so they are 



1 
1 



1 

1 



The quantum operator can be a general unitary operator 



cos a 
sin 9e^ 



smfe 
— cos ( 



The payoff function is usually defined as 



E'^ = Tr{PAPe) = -E 



B 



in which 



Pa 



1 





-1 



-Pb 



means, player A gets 1 when the quantum object ends in \U) state and loses 1 when in 
\D) state. 

Considering the relation between classical game and quantum game, we redefined 
quantum game with a slightly difference with the definition eau (|23() as 



r = {n, PO, {S% S%) , {S'a, 5|) , Pa, Pb) , 



(24) 



in which is the set of quantum operators while Sf is the set of classical operators, 
usually Sf is a subset of Sj, but not necessary. 



2.4.1 Base vectors and strategy space 

Now let's use our new mathematical representation to reexpress the Quantum Game 
Theory. Because Quantum Game Theory is constructed on the basis of quantum state 



9 



of a quantum object, 7i, it provides a set of natural base vectors of strategy space. For 
quantum penny flip game, all strategy are operators with the form of 

A = Auu \U) {U\ + Aud \U) {D\ + Adu \D) {U\ + A^ \D) {D\ . (25) 

So the base vectors are = {\U) {U\ ,\U) {D\ ,\D) {U\ ,\D) {D\}. Furthermore, if we 
define the inner product of operator as 

{A\B) = Tr (a^b) , (26) 



is a complete orthogonal base vector set for all quantum operators. Then the 
operators can be regarded as vectors in Hilbert space, a Hilbert space of operator, 
which we denote as = {\UU) , \UD) , \DU) , \DD)}. 

The classical strategies are 

\N^) = \UU) + \DD) , \F^) = \UD) + \DU) . (27) 

In order to form another complete orthogonal base set, we need to define other two 
base vectors as 

liV?) = \UU) - \DD) , 1^9) = -i \UD) + i \DU) . (28) 

Then operator space can also be expressed by = {\N'^) , \F^) , \N^) , l-F'^)}, while 
the classical strategy is = {\N'^) , l-F*^)}. \UU) is the operator to turn the \U) into 
no definition when the initial state is \D). A meaningful operator should give the 
end result for starting state both as \U) and \D), so operators {|A^'^) , \F'^) , |A^'') , |-F'^)} 
are better than {\UU) , \UD) , \DU) , \DD)} in this. Another advantage is that all the 
base vector are unitary and hermitian operator. It's easy to prove that under our 
definition of inner product, the matrix form of {A\ is just A'^ . For such base strategies, 
A'^ = A, so 1^) and {A\ have the same the matrix forms. But {A \A) = Tr (/) = 2. So 
a unitary operator is not in unit magnitude. One way to solve such conflict is redefine 
base vectors as A^ -^A, but here we prefer another way to keep the form of unitary 

v2 

operator, and to redefined inner product as 

Applying our representation onto this quantum penny flip game, the system state 

is 

p^ = p'x p\ (30) 
The single-player state coming from classical sub strategy space is 

f^,= {l^nc\N')m+p)cW')m)- (31) 

If we quantize it anyway as we did in section H2.3I that in a pure state of quantized 
classical game, the single-player state is 

= <Xc m {N'\ + m {F'\ + x},4, {N-\ + x},x}, \F-) (32) 
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Then will have off-diagonal term, while /j^ only has the diagonal term. Now, applying 
our representation onto quantum strategy space of this penny flip game. The single- 
player state is 

-«Q = E4^tl/")(^l- (33) 

Here v can be any one of {\F^) , [A^*^) , \F'^) , lA^*^)}. Next step, we allow our strategy 
can be mixture state in H^. The single-player state of a general mixture strategy will 
be 

PQ,a = EPMl'")(^l' (34) 

where are quantum pure strategies, may or may not equal to {\N'^) , \F^) , | A^'^) , \F'')}. 
This means Pq ^ is mixture state but maybe diagonal in other set of base vectors. A 
more general system state can be constructed in the quantum strategy space by 
destroying eau(|5n|). We ever mentioned in the last part of section ^2.'S\ that density 
matrix of a general state is not required to be a direct product to density matrix of 
every single player. But still, the meaning of such state is not clear here. 

In the later discussion, we name equ (|HT|) . equ (|H^ . equ ips and equ (|ni|) as classical 
game (CG), quantized classical game (QCG), pure-strategy quantum game (PQG) and 
quantum game (QG), respectively. And in the classical game, when the system density 
matrix is not a direct product, we call the game as entangled classical game (EGG), 
while for quantum case, entangled quantum game (EQG). The strategy space of all 
these games have the relation that 

J CG = QCG C ECG, for classcial game , . 

\ PQG C QG C EQG, for quantum game ^ ^ 

The relation is 'C' not 'C' because it's possible that the later has no independent 
meaning other than the former although the later has a larger strategy space. In fact, 
for classical game, we still have another smaller strategy space — classical pure strategy 
space, and the game in that space — pure-strategy classical game (PCG). Fortunately, 
the relation between PCG and CG is already clear enough through Nash Theorem, so 
it's not necessary to discuss it anymore. 

2.4.2 The payoff matrix and its non-zero off-diagonal elements 

Now all games have been unified in our mathematical representation. Everyone has its 
own strategy space and base strategy vectors. In order to finish presenting our repre- 
sentation, we need to calculate the new payoff function H^. Let's still use the quantum 
penny flip game as an example. In Quantum Game, because the non-commutative 
relation between operators (base vectors), the order of acting effects the results. On 
the contrary, in classical game, usually the base vectors are commutative, so the order 
of acting doesn't matter. We can see this by 

[A^^ F"] = 0, 
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but 







-2i 



-2i 



-liF" / 0. 



We define the order is (1,2,1,2,...), then the original payoff function is defined to 
take the value of 



E'{U'^,U^) = Tr ( P'U^U^po (u^ 



(36) 



where {/* is anyone of {A^", F"^, A^*, F'}. This will give all 4 x 4 values of {G^^lu) i^^^i^^- 

In classical game, we require and notice that is naturally a (0, 2)-tensor, because 
the payoff of mixture strategy is the weighted average with their own probability. The 
linear property of this payoff is a requirement of our new system-level payoff function, 
which is a (1, l)-tensor, or we say, linear for right vector, anti-linear for left vector. But, 
here in quantum game, from eau H36|) we find G' is definitely not a tensor, not a linear 
mapping, 

G (atj^, \ = a*aG (u\ ■) / aG (u\ 



Then is it possible to transform such payoff into system-level (1, l)-tensor? We need 
to prove it. From classical game, one thing we already know that in the classical state 
subspace = {N'^jF^}, no matter the strategy is pure or mixture, such transforma- 
tion exists. So we use three steps to prove that a system-level (1, 1) tensor payoff can 
be constructed. 

First, for system state only staying on one base vectors {N'^,F^,N'',F'^}, so that 



p' = \S) {S\ and \S) = \s\s^) , 



We define the elements 



H 



ss ■- 



{S\H'\S) = Tr(P's^s^po (s 



G\ 



H 



ss' 



S\H'\ S' ) = Tr[P\s^'s^'pQ is 



l^t,^2^t 



(37) 



(38) 



For example, Hncnc-ncnc = 1' which means when both player 1 and player 2 choose 
F'^, player 1 wins; Hnc,nc;nq,nc = 1; which has no classical meaning, because it's a 
off-diagonal elements. It's easy to prove that is hermitian. 



^s's 



S W S 



a' 



Tr I P^s^sVo ( s 



Tr [s"' s"' pises' (P*)^ 
Tr (P's^'s^'plsh^ 



H 



ss' 
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in which, we require 

[piy =p\ So 



(39) 



Second, we prove that for a system state not staying on the base vector, but on 
pure state, such as 

p' = \S){S\ and \S) = xl\s\,s^) + xl\sl,s^) , 

we still have (S) = Tr {p'W) = {S\ W \S), in which W is a (1, l)-tensor. 
Proof: from payoff definition eau H36|l . 

E\x\\s\) + xl\sl) ,\s'^)) = Tr[p^s'^{x\s\ + x\sl)pQ{x\s\ + xls\)^{s'^)^^ 

= x\x\Tr(p^s'^s\po{s\)^{s'^)^\ + 
x\x\Tr [p's'^sIpq (4)"^ (s2)n + 
x\x\Tr Ip's^sIpo (sJ)"^ (s^)^ + 
xlxlTr [p^shlpoisiy {s^y), 

in which we need the property that Tr (•) is a linear operator. On the other hand, 
when W is a (1, l)-tensor, 

{S\W\S) = {xl{sis^\+xl{sis'\)H^{xl\sis^) + xl\sis')) 



\xl 


(■^1' 


S2 


w 




1^2 


(^2i 


s2 


w 




2^1 


\Si, 


S2 






2^2 


(■^2; 


s2 


w 


sis') 



Using the definition of -f^^^/ in eau ()38() . we know they equal. 
At last, we prove for a mixture state, such as 

p' =p\ \sls') {sls'\ +pI 14, s^) (4,s2| ^ 

we still have E' (5) = Tr {p'W). 
Proof: using above result, 

Tr{p'^H') = E^.,u{l^,''\p'H'\p,u) 

= p\ {si s' \W\ si s') + pI {si s2 \W\ si s') 
= pIe'{sIs-')+pIE^sIs') 
= E'{S) 

Therefor, for any system state we still have 

E' (S) = Tr {p'H') . (40) 
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The payoff matrix of tfie quantum penny flip game is a 16 x 16 matrix 
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and = —H^. Compare with the payoff matrix of classical game with the payoff ma- 
trix of quantum game, a significant difference is that the later has non-zero off-diagonal 
elements while the former only has diagonal elements. Through this representation we 
know the difference between classical game and quantum game is not only the size of 
strategy space but also the off-diagonal elements of payoff matrix. 

Prom W above, the sub-matrix related with {A'''^,^'^} is 



10 1 
0-1-10 
0-1-10 

10 1 



They are different with the new payoff matrix of the original classical game, 



TTt,C 

original 





-1 









-1 










1 



2,c 

original ' 



which only has diagonal terms. So we can say, the quantization process changes the 
definition of the original classical game. However, the meaning of quantum game does 
not completely depends on the equivalence with the original classical game. So even 
given such difference, quantum game is still probably a new game. 

If we defined a quantum game by payoff matrix another privilege of this new 

representation is that the definition of a quantum game is independent on {TC,p), the 
state of a quantum object. Our payoff function can be directly defined on system 
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state . Of course, any payoff defined on (H-iP) can be transferred equivalently into a 
function on p^ . So a quantum game can be defined as 



N 



N 



r = m (x5^'«) , JJ (x^^''^) , {w} 



(41) 



in which S"'^ has base vectors | and Sf has base vectors | Usually the 

later is a subset of the former. A classical payoff function is defined on system base 
vectors such as = \S) Hgg {S\, while a quantum payoff function is defined as 



-ff* = ^ /^ss' \ "S" • If is a subspace of Sf, the payoff matrix of classical game 

just take the corresponding diagonal parts whether the corresponding sub-matrix of 
the quantum game payoff matrix has non-zero off-diagonal terms or not. 

In the next part of this paper, we try to make use of this representation and hopefully 
to find something significant. 



3 Pseudo-Dynamical Theory of Equilibrium State 

In the new representation, a game seems very similar with an Ising model with global 
interaction. The payoff of every player is related with everyone else. The state of every 
player can be represented by a quantum state vector or density matrix. Every player 
try to stay at point with the maximum payoff, while in Ising model, the whole system 
try to stay at minimum energy point. The distribution of a quantum system at thermal 
equilibrium is 

p = ^e~f^" and Z = Tr (e"^^) , (42) 

where H is the system Hamiltonian, Z is so called partition function. 

Now as in Statistical Mechanics, we introduce the idea of distribution function of 
state into Game Theory, but instead of function in T space in Statistical Mechanics, 
here in p space, the state space of every single player. A natural form is 

pi ^ i^iBH}, Z = Tr (ef^^k^ , (43) 

in which Hj^ is the payoff function of player i in its own strategy space and Z is the 
partition function in i's strategy space. The payoff matrix we have now is defined 
in system strategy space. So a kind of reduced matrix is what we need to find. 

Before the detailed calculation, one thing we should notice that the equilibrium 
density matrix description is different with the classical mixture strategy. If the eigen- 
vectors of Hj^ can be found as then 

p' = Y.pUi^ni^f (44) 
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is similar with the classical mixture strategy form, and p^^^ can be regarded as the 
probability on strategy fi'^. But first, such an set of eigenvectors is not always the 
same as the classical base vectors, because sometimes, we have non-zero off-diagonal 
elements. Second, such a density matrix gives the probability of any pure strategies \s) 
even being different with the base vector, by 

pI = {s\p'\s). (45) 
This is impossible in mixture strategy description. 



3.1 Reduced payoff matrix and Kinetics Equation for Equilibrium 
State 

Now we start to define the reduced payoff matrix and investigate its properties. A Nash 
Equilibrium state is defined that at that point every player is at the maximum point 
due to the choices of all other players are fixed. A reduced payoff matrix should describe 
the payoff of a single person when the choice of all other players. In the traditional 
language of Game Theory, such a reduced payoff matrix is equivalently to be defined 
like the end result of equ (|14j) under any arbitrary fixed LP^) . But we need a matrix 



form here. 

For pure system strategy, H'^ {{S\ ■,\S)) is a (1, l)-tensor. In a 2-player game, 
{{s^\ , (s^l ; \s^) , can also be regarded as a (2, 2)-tensor. A reduced payoff 
matrix of player i means in the viewpoint of player i it should be a (1, l)-tensor. When 

both player 1 and player 2 stays on pure strategy \s^) , s^fixedj respectively, it has 

a natural definition, H\ [{s^\ ; \s^)) = (^{s^\ , (s^i^ed ! K> ' ^^^ed))- Since our 
strategy can be a mixture state, or generally a density matrix form, we need to gen- 
eralize the above definition. A reduced payoff matrix of player 1 in a 2-player game is 
defined as 

Hi = Tr\p%,,,H'), (46) 

where Tr^ is the trace in subsapce of player 2. From eau H4U|) . the payoff value of player 
1 is 

= Es{S\p'p'H'\S) 

= E.pPUW\Tr'{p'H')\a) 

= Ea/3/>i/3(/3|^i?,l«) 
= Tr^p^H},) 

So if we know the reduced payoff matrix of player 1, the payoff value can be calculated 
by 

E'=TrHp'H},). (47) 
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In fact the Tr^ action is quite hard to perform, because this requires the result of 
a trace is a matrix, not a number as usual. An equivalent but easily understood form 
of eau (|lH|) is 

in which H^^ is a sub matrix with fixed player I's index (here, first and third index). In 
order to define a general form for A^-player game, we denote the trace Tr-i as diagonal 
summation in the space except player i's. So in 2-player game, Tr^ = Tr2. Then a 
general reduced payoff matrix of player i under fixed strategies of all other players is 



HI 



N 



(48) 



Still using the Prisoner's Dilemma as example, when player 2 choose strategy C 
with p1 and D with p^, the state is 



P 











Then 



Hi 



Pc 





5pl 



-2 











\ 





-5 

































-4 _ 


/ 











■Pc 



Apj. 



Recalls Metropolis Method and its derivative Heat Bath|5] Method in Monte Carlo 
Simulation of Statistical Ensemble. In the simulation of equilibrium state of Ising 
model, every single step, when a random spin is chosen, it faces the same situation 
with our game player. All other spins have decided one state to stay temporary, it has 
some choices of its own state by evaluating the energy difference between all its possible 
states. Then it choose one state to stay by a transition probability or transition rate 
over all possible states. The Kinetics Equation for such process is not unique, different 
forms of transition probability can give the same equilibrium state. 

Now we face a quantum system, although a similar situation. Every player should 
make his decision every step with the fixed state of all other players and we also ask 
for the equilibrium state. The reason that different Kinetics Equations give the same 
equilibrium state in Statistical Physics is the well-known Detailed Balanced Theorem 
in thermal equilibrium, but we don't have a corresponding one in Game Theory. We 
now just suppose that at equilibrium state, the density matrix of player i's state is 



^ef^^R and Z = TrU ef^^R 



And we choose a heuristic Kinetics Equation as iteration equation, 

1 



P' it) 



(49) 



(50) 



Z(t-1) 

Then the equilibrium state is defined as the fixed point of this iteration if it has fixed 
point. 
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3.2 Examples and the effect of /? 



In fact, Kinetics Equation eau (|5U() is related iteration equations. The existence of 
the fixed point is not obvious. Even the questions itself is not unique, although the 
experience in simulation in Statistical Physics implies that such equation should exist 
probably with different form. The fixed point might be different with Nash Equilibrium 
even if it exists. In this paper, all these questions are neglected. Let's first test such 
idea in some examples, just like what a physicist usually does, not a mathematician, 
who will pay more attention on a general definition of equilibrium state and the proof 
of the existence. 

Eau H5U|) of a classical game is much easier to deal with than the one of a quantum 
game. In classical game, both H'^ and are diagonal. The density matrix at time t 
can always be written as (t) = X^qPo (*) \'^) (q^Ij then eau (|5n)) will lead to a series of 
evolution equations for (t). 

However, in quantum game, since the payoff matrix has off-diagonal elements, 
the reduced payoff matrix also can have off-diagonal elements. Then the density 
matrix can be equivalently replaced by evolution equation of pi (t) only when the 
density matrix is expressed in the base vector formed by the eigenvectors of H^j^. But 
with off-diagonal elements, such eigenvectors are not always the base vector we used to 
express the game and they might change during the iteration process. So the first step 
is to solve the eigenvalue equation of and H^j^. 

3.2.1 Eigenvalue Problem 

The eigenvalue problem in classical game is quite easy. All the eigenvectors are the 
base vector we used, the eigenvalues are just the corresponding diagonal elements. In a 
quantum game, it depends on the details of payoff matrix. For example, in the quantum 
penny flip game, the payoff matrix has 16 x 16 elements. Even when player 2 choose 
p2, fixed _ i^c^ (A^'^l, the reduced payoff matrix of player 1 is 




1 

1 






-1 




—I 



1 


1 







-1 







The eigenvalues and the corresponding eigenvectors are 



/ -2 ^ [0,-i,0,lf \ 

2 ^ [1,0,1,0]^ 

^ [-1,0,1,0]^ 

\0 ^ [0,i,0,l]^ / 



This means a quantum player can make money over the classical player with p2,/ixed 
by using strategy ^ [1, 0, 1, 0]^. And the funny thing is the value of payoff the 2, not 
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1 in classical case when player 1 uses [1,0,0,0]"^. It clearly shows the effect of the 
off-diagonal elements for a quantum player. If the player 1 is still a classical player, the 
strategy he can use is just A^'^, F^, so he will get 1, —1 respectively. Anyway, the topic 
of this section is show the way to do the iteration defined in the Kinetics Equation 
eau (|5U|) . not the reason of such difference. 

Now we have the idea. Starting, for instance, from player 2 choose (i = 0) = 
p2jixed^ the state of player 1 is then 

p' it = l) = ^ ^ ^^0/3 1-2) (-21 + |2) (2| + |0i) (Oil + IO2) (O2I) • 

And then substitute it back to eau (|5n)) and do the iteration. However, from above 
density matrix we know that even beginning from a pure state, the state after one 
iteration will be a mixture state. In classical game, it doesn't matter, because the end 
state generally can be a mixture state, and a pure state is equivalent with a mixture 
state with the same diagonal part. But in quantum game, mixture strategy is quite 
different with a pure one. One way to deal with this problem is to set (3 = 00. Then 
the Kinetics Equation of quantum game becomes, 

in which \s'^]^^g^^ is the eigenvector with maximum eigenvalue of the reduced payoff 
matrix. So only the maximum one is kept after every step. But this will brings new 
problems when the real equilibrium state is a mixture state. So for quantum game, it's 
better to regard the approach shown here just as an idea. Later on, classical game is 
our main object. The task of this section is just to point out that a quantum game 
brings new things such as eigenvalue problem while which is quite trivial in classical 
game. 



3.2.2 Equilibrium state calculation of several examples 



Now we come to use our Kinetics Equation approach on some examples of classical 
game. First, let's finish the discussion about the Prisoner's Dilemma. We already 
know 



Hi 



-2pl - 5pI 





.2 _ /|„2 



and H'i 



2pl - 5p\ 
• pi - 4pi 



0-pi-4p'^ 
Suppose we start from player 2 with (p^ (0) , 1 — (0)), then from equlj^OJ, 



pI it) 



/3(-2Pc(t-l)-5Pd(*-l)) 



pI {t + 1) 



l+e''{i+PcW) 
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Figure 1: The iteration process defined by the Kinetics Equation of Prisoner's Dilemma 
drives the fixed point from a finite number to when (3 growths. Because here only 
one parameter pc we need to calculate, a simple fixed point graph shows the result. 
Usually in a multi-strategy game or with more players, we will have more parameters 
and more complex equations. Then in that situation, we will have to use simulation. 
The function plotted here is pc = j^:^^t+^- Because the two steps of one iteration 
use the same function form, it can be regarded as two iteration steps with only one 
function. 



When P = oo, which means infinite resolution level, or we say, any difference in payoff 
is significant, then = = p"^. The equilibrium state is {D,D), which is equivalent 

with Nash Equilibrium. When (3 is finite, denote the fixed point as (pc'*,Pc'*^- The 

stability of this fixed point can be analyzed by the linear stability matrix. 



S 



dpi 

dpi 



'dpi 

dpi 



1,* 2,: 

Pc 



dpi 
dpi 



(n,iOx(n. Li) 



{pi)* 



(52) 



In this specific case, it's unstable, the fixed point graph of the Kinetics Equation is 
shown in fig©. When /? = 0, which means the players care nothing about the payoff, 
then p]. = \ = v1- Of course, such solution is useless, but still consistent with our 



intuitive result. 



Second example, we choose Hawk-Dove, a two-pure-NE game. The payoff matrix 
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of player 1 and 2 are 



3 

10 

4 





3 

4 

10 





The reduced payoff matrix is 



A (3-*) 



Then the Kinetics Equation is 



Ph 



P[Ph -Pd 



1 + e 



It's easy to know that when /? = oo, fixed point are [p\ = 0,p\ = l), {p\ = \,p\ = \) 
and [p\ = l,p| = O) depending the initial state p\ > p% p\ = p\ or p\ < p% For a 
finite (3, a fixed point graph is shown in fig((2j. 

The third example is the classical penny flip game, which has no pure NE. The 
payoff matrix are 



The reduced payoff matrix is 



-1 



H 



R 



p) 



Pf 



pI 



H 



R 



P) 



P\ 



pi 



p) 



Then the Kinetics Equation is 



pi 



1 + e 



-,pI 



1 + e 



From fig®, {pji = = \) is the only fixed point no matter /? = oo or not. And 
even the only fixed point is unstable. 

The Kinetics Equation, its fixed points and the stability analysis of the fixed points 
gives a method to find equilibrium state and to refine them if we require an applicable 
equilibrium point is a stable fixed point. From all the trivial cases we tested it seems 
valid. But questions such as more tests, a general form of such equation, and the 
relation between such fixed points and Nash Equilibrium is waiting for more detailed 
discussion. 
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There are 



three fixed points for this iteration process. One is unstable fixed point, 0.5, while the 
other two are stable fixed points closing to and 1 respectively, when (3 grows. In 
figure (b), we explicitly show the two iterations instead of the self-mapping from p\ to 
p\ in figure (a). It gives more details. (0.5,0.5) is still an unstable fixed point. While 
the end state can be a (0, 1) or (1,0) depending on the initial state. 
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Figure 3: In figure (a), the function plotted liere is 



-. The 



2Q[ 1 — 2 - 

l+e V l+2/3(2pl-l), 



only fixed but unstable point is always 0.5 for different /?. In figure (b), two iteration 
functions are used to show a clearer but more complex picture, from which we know 
(0.5, 0.5) is still a fixed point, but if starts from initial state other than this point, the 
system will jump between (0,0), (0,1), (1,1) and (1,0). 
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At last, we have to admit that our simulation is not equivalent with the Kinetics 
Equation. Pure strategies are included by the Kinetics Equation, but since our algo- 
rithm is classical, here we only let it evolute in the subspace of mixture strategy. For 
classical game, this is not a fatal problem, because we have prove that pure strategy 
is equivalent with mixture strategy having the same diagonal part. But for a quan- 
tum game, pure strategy is totaly different with the mixture classical one because of 
the off-diagonal elements of payoff matrix. Is it possible to find such a simulation 
algorithm? 

On the other hand, when /? 7^ 00, the fixed point of our Kinetics Equation might 
not equal to the Nash Equilibrium state. Such fixed points are the end states when 
the average resolution level of all players is /?, which can be regarded as a typical scale 
which players care. This concepts may expand the description of Game Theory into 
the situation that players are not complete rational. They can evaluate the payoff, but 
not explicitly, only a rough range. And from the experience in Statistical Physics, es- 
pecially Phase Transition, we know that even when (3 is not very large but large enough 
the lowest energy mode (here, maximum payoff mode) will dominate the system. This 
means, under some not extremely restricted conditions, the traditional Nash Equilib- 
rium is still valid. It will be funny if one can prove such conclusion from a general 
situation in our equilibrium definition. 

4 Discussion 

It's quite straightforward to extend our notation into A'^-player game and continuous 
strategy case. However, although a new representation has been introduced to express 
everything in a static game, the advantage of such a language and the meaning of all 
other games is still open. And further more, if it's acceptable for static game, is it 
possible to be developed into Evolutionary Game Theory? And cooperative game? Is 
it related with entangled system state? 

As discussed in section l3?2l because of the iteration procedure and the distribution 
function we used, a natural way of equilibrium calculation and refinement is provided 
by our pseudo-dynamical method. The non-trivial phase transition happening in Statis- 
tical Physics at finite (5 = f3c implies the probability that when >> 1 the traditional 
equilibrium state can be reached at some finite noise level, not necessary at no-noise 
infinite-resolution background. In this paper, we only argued such possibility, not by a 
real example. Further analysis should be done to confirm such statement, although we 
believe it from the background in Physics. 

And as discussed in section ITU when our representation is used in Quantum Game 
Theory, a set of base vectors of strategy (operator) space and their inner product need 
to be defined to form them as a Hilbert space. Then all the other procedures are quite 
straightforward. At least, it gives equivalent description. But there are still some open 
questions, like what's the meaning of a non-unitary operator in the strategy space? 
Does physical operator have to be unitary operator? Another interesting question is 
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the effect of base vector transformation of Hilbert space. What happens if base vectors 
other than our (N^, F^, N'' , F"^) are used? 

We have to say our present result is a theory far from complete. It stacks in our 
hands for a very long time, now we want to share the idea with all. In fact, it's even 
possible to be nothing than a toy representation of Game Theory. However, even in 
such case, it's still of little value to provide a unified description and a possible pseudo- 
dynamical equation theory which might be completed later so that the end state of 
iteration from an arbitrary initial will be the Equilibrium State. As you may already 
noticed our paper is filled with questions other than their answers. Hopefully it will 
motivate the discussion. Ironically, during the revision of this paper, we found that 
the idea using a Hilbert space to describe classical and quantum strategies has been 
proposed in [Jj long time before. So our works can be regarded as a realization and 
development of this idea. In our paper, not only strategies, but also payoff functions 
has been reexpressed into Hilbert space and operators on it. 



5 Conclusions and outlook 

Besides lots of questions in above section, here we summarize the reliable conclusions we 
have till now. First, in the new representation, all games including classical, quantum, 
even entangled game, under general iV-player ^Hi^i case, can be defined by a 
unified definition as equ (|41|) . All the difference among the games is at the base vectors 
of strategy space and the payoff matrix — a (1, l)-tensor. In the traditional form, 
payoff function of A^-player classical game is (0, A^)-tensor; and for quantum game, it 
depends on Ti and po, even not a tensor form. We have to use special language for 
every specific game. 

Second, in our representation, for quantum games, it's easy to see the role of Off- 
diagonal elements of payoff matrix when we say a quantum player can make more money 
over classical player. If the payoff matrix is diagonal, it makes no difference, although a 
quantum player can make use of quantum pure strategy, which has off-diagonal elements 
in density matrix. Game Quantum is only possible when both density matrix and payoff 
matrix have off-diagonal elements. However, unfortunately, as we have pointed out in 
section ^2.4.21 quantization of classical game probably changes the definition of original 
classical game. 

Third, with the form of payoff matrix and reduced payoff matrix, equilibrium density 
matrix in Quantum Statistical Mechanics e^^R gives an equilibrium distribution over 
strategy space. This provides some flexibility on the application of game theory such 
as average behavior and collapse into Nash Equilibrium under infinite resolution level 
(/? = oo). This helps take partial rationality into our theory. Therefor, for classical 
game, although our new representation brings nothing new theoretically, it may provide 
some new technical tools to analyze the NE, to include partial rationality, and to develop 
evolutionary game. 
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If such a representation can provide some other insightful advantage besides an 
equivalent representation of both Classical and Quantum Game Theory, it's necessary 
to try more real games, both classical and quantum, in the new framework. From the 
section ^3.2.11 we see that because the system space is the direct space of all players', the 
matrix form will be so large that it make all calculations un-convenient. In Quantum 
Mechanics, the idea to solve such problem is to introduce particle-number represen- 
tation to replace direct product of base vectors. For undistinguishable particles, such 
approach significantly reduce the hardwork of calculation. Maybe such simplification 
can be generalized into Game Theory. 
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